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This study examined the construct^. validity of the 
subtests in the California Entry Le.vel Test (3LT) • The ELT is 
administered to every first grade pupil in California as part of the 
California Assessment Program and is used as a baseline measure of 
the prereading skills of beginning first graders* The discriminant 
validity of the subtests was demonstrated by a factor analysis of 
item scores from 3,010 pupils (a one per cent random sample of all 
first graders tested) • A Principal components analysis, followed by 
v-arimax rotation, yielded a factor structure analogous to' the test 
structure* Items from each of the five subtests loade^l only on their 
own factor except for a few language development items which had 
secondary loadings with other factors* Multitrait-multimethod 
correlation matrices were. used to determine the agreement of ELT 
subtests with corresponding subtests in four popular readiness tests* 
Findings were mixed* Subtests had convergent validity with other 
measures of the same construct, but only the subtest with the 
greatest variance had discriminant validity consistently* (Author) 
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The purpose of this paper is to examine the construct validity of 
the subtests in the California Entry Level Test (ELT). The ELT is admin- 
istered to every first-grade pupil in California as part of the California 
Assessment Program and is used as a baseline measure of pre-reading skills" 
for children at the start of first grade. ELT scores are used with demo- 
graphic variables to predict differences among schools on subsequent 
reading achievement tests. The predictive validity of the ELT depends 
on how well the test measures the constructs, it was intended to measure, 
as well as the relationship between those constructs and later success in 
lemming to read. The purpose of the study is "to address the first issue; 
how well do- the ELT subtests measure what they are supposed to measure? 

* ■ 

The focus of the study is the discriminant validity of the subtests. 
Are they each measuring a distinct skill or ability corresponding to the 
subtest name: Inraediate Recall", Letter Recognition, Auditory Discrimina- 
tion. Visual Discrimination, and Language Development? The skills assessed 
by the subtests are expected to be correlated, but if they are measuring 
what they are supposed to measure, they should also be distinguishable 
as separate constructs. The discriminant validity of the subtests is 
practically as well as theoret^'cally significant because the subtests 
will enhance the total -variance-accounted-for (and hence the predictive 
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validity), if each contributes some xinique portion to the total variance 
over and above the variance common to all subtests. 

A secondary aspect of the study is the convergent validity of the 
subtests.; Are each of the subtests correlated with measures of the same 
skills in other pre-reading instruments? 

method' 

Subjects 

The ELT was administered to 301,000 first graders in California 
during the third week of October, 1973. A one percent random sample was 
taken from the total pupil file for the analysis reported here. 

Classroom teachers coded each test booklet indicating the pupil's 
ethnic group, bilingual ism (level of fluency in English + other language 
spoken), and socio-eclanomic status (SES). In addition, districts that 
routinely administered readiness tests in October were asked to supply 
subtest scores for .each pupil, to be correlated with ELT scores for use 
in the convergent' validity study. Each of the o,ther readines: measures 
was administered in one or two districts. The smallest number of first 
graders tested with any one of the readiness tests was 550. 
Test Construction 

The ELT was developed by the California Department of Education as 
part of its State Assessment Program. The ELT was not designed as an 
achievement measure; its purpose is to identify initial differences 
among schools that might predict reading success. An advisory com- 
mittee of reading experts selected those pre-reading skills that were 
related to reading performance and were amenable to group testing. The 
final list of skills reflected a balance between the need to represent 
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the widest possible range of releivant skills and the need to ke^ep the lj?st 
short and avoid frequent changing of the response mode. 

Before developing specific i terns > rules were formulated which char- ^ 
acterized the type of item appropriate for each subtest and which clarified , 
the distinctions among the subtests. For example, distractors for Letter 
Recognition items were selected from near the correct letter in the alpha- 
bet rather than relying on distractors that looked or sounded like the 
correct response. The'common p, q, and b, d confusion v/as, therefore, re- 
served for the Visual -Discrimination subtest. In ar\ effort to^distinguish 
auditory discrimination from language development. Auditory Discrimination 
items were screened to eliminate unfamiliar nouns; then test administrators 
named each stimulus and^all the response choices so that vocabulary would 
not interfere with the auditory task. The Immediate Recall subtest is 
a paired-associates task in which two familiar but unrelated nouns are 
pictured together. Children are taught six pairs and then asked iimiedi- 
ately to* mark the pictures that go together. The pairing of nouns that 
are not normally associated makes the subtest more clearly a measure of 
immediate memory, uncontaminated by language development. These efforts 
to enhance the separateness of the subtests were made to obtain greater 
face validity and to maximize the total variance accounted for by the 
composite score. 

The ELT'v/as designed to be a very easy test. Because it would be 
used 'to discriminate among schools with respect to the average le^^el of 
pupil skill and not to discriminate among pupils, large between-pupi 1 
variability was not essential. The pupil distribution could be markedly 
skewed and yet one would obtain a nearly normal distribution of school 
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means. ELJ scores are not reported for individual pupils; school and 
district mean scores are used in multiple regression .analyses of school 
and district mean achievement scores^ 
Procedure 

The responses to the 36 items (four subtests of six items. Language 

Development vn'th 12)', t)ie five subtests, and the total ELT score sWere 

intercorrelated and factor analyzed using the SPSS factor analysis program 

(subroutine PAZ, principal -axis factoring with iteration). The programs 

computes a principal components solution. Factors with eigenvalues of 

.95 or above were retained for a varimax rotation. Several additional 

fa*ctor analyses were done in which different variables were added or 

deleted. The simplest analysis included only the 36 item responses. The 

most inclusive analysis had" pupil SES, bil ingual ism, and ethnicity as 

» 

vari^ables in addition to item arid subtest scores. 

The principal factor matrix from the SPSS output was entered into 
the Harris-Kaiser "ortho-bl ique" transformation program to obtain an 
oblique solution. The routine was repeated using both'the independent 
clusters and A'A proportional to L options. 

Mul titrait-multimethod correlation matrices v;ere constructed w^ith 
the ELT subtest and total scores and the subtests from the Metropol itan 
Achievement Test and each of three popular readmg readiness tests: 
McHugh-McParland, CTBS , and Clymer-Barrett. Data were obtained for 
eight tests other than the ELT ; four tests were not analyzed, however;, 
because neither the districts nor the scoring agencies could provide 
subtest scores. 

5 
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RESULTS AND DISCUSSION'' 

Pupil Level of Analysis 

Construct validity at the pupil level is essential for construct 
validity at higher levels of aggregation. It is unlikely that discrim- 
inations among schools could be construct valid without evidence, of con- 
struct validity at the pupil level. This 1s the rationale, then, for 
analyzing pupil level data to judge the construct validity of an instru- 
ment that will be used at the school and district level* This is a 
first step. Subsequent evaluations of the ELXwill include, obviously, 
its correlation with subsequent "reading scores and a study analagous 
to this conducted at the school level. 
Difficulty Level 

The ELT was very easy for most first graders- The percent passing 
each item is reported in Table 1. The^ extreme simplicity of most of the 
items and subtests will influence the interpretation of results reported 
in later sections. Very simple items or very difficult items have low 
variability which will attenuate correlations. 
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TABLE 1 

Entry Level Test 
Item Means 

N=3010 pupils (1% of 301,000) 



Imm, Recall Letter Recog . Aud. Discrim . Vis. Discrim . 
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.74 
.56 
.67 
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.91 
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.94 
.93 
.85 
.93 
.80 
.88 
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.96 
.97 
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31 
32 
33 
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35 
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.86 
.89 
.77 
.45 
.85 
.61 



Item and Subtest Intercorrelations 

The ELX subtests are correlated with one another. The Inmediate Recall 
subtest correlates with the other four subtests on the order of .22. The 
other su1)tests correlate with each other on the order of .51. When school 
means are correlated for the 4686^ schools in California the magnitude of 
the relationship of Immediate Recall with the other subtests stays about 
the same but the relationship among the others increases to an average of 
..57. These correlations are consistent with the hypo thes"** zed relationship 
among the constructs. Immediate Recall i? the least influenced by back- 
ground experience and therefore should not be highly correlated with the 
Other four subtests. The correlations among Letter Recognition, Auditory 



ERLC 



r 



-7- 



Discrimination , Visual Discrimination, and Language^ Development are 
substantial given the easiness of their constituent items. On the basis 
of this data one would conclude that the constructs are either highly 
related or redundant. 



Imnu Recall 
Letter Rec. 
Aud. Disc. 
""'Vis. Disc. 
Lang. Dev. 
TOTAL 



TABLE 2 

Entry Level Test 
Subtest Correlations 

, N=3010 pupils {\% of 301,000) 
(N«4686 s-chool means without pupil sampling) 



IB 

1 .00 



LR 


AD. 


VD 


LD 


.22 


.16 


.24 


.23 


(.17) 


(.19) • 


(.24) 


(.22) 


1.00 


.51 


.50 


, .57 




(.54) 


(.60) 


, (.54) 




1 .00 


.41 


.52 






(.51) 


(.70) 






1 .^0 


.54 








(..57) 








• 1 .00 



Totfeil 



r.oo 



There is some- evidence for the separateness of the constructs in the 

* 

item intercorrelation matrix (Appendix Aj. Items are on the average more 
highly correlated with other i^tems in their own subtest (triangles along 
the diagonal) than with items in other subtests. When a Weaker item 
appears in a subtest, such as item 18 in Auditory Discrimination, other 
items measuring the same construct may have low correlations with it that 
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are equaled by cross-test correlations; but even in the weakest cases 
the cross-test correlations do not exceed the within-tqst correlations. 
Factor Analysis 

Both the orthogonal and oblique factor solutions (appendices B and 
"T) "provide striking evidence for the discriminant validity of the ELT 
subtests. Despite the relatively high intercorrslation of four of the 
five subtests, each of the five subtests had sufficient unique variance . 
to be distinguishable as its own factor. In the orthogonally rotated 
^ matrix, factors one through five can be identified as auditory discrim- 
ination, visual discrimination, letter recognition, immediate recall, 
and language development respectively. The total test score," which is" 
the simple sum of the 36 items, is dispersed acfoss these five factors. 
Items from Immediate Recall., letter Recognition, Auditory Discrimination, 
and Visual Discrimination had high loadings with their own factor. on the 
order of .50 to .,65, and did not load with any other subtest factor. 
Three Immediate Recall items had secondary loadings with two unidenti- 
fiable factofs, two with factor seven and one with factor nine. One 
Visual Discrimination item also had a minor loading on factor nine. 
Even with .these imperfections it is apparent that the factor structure 
is the same as the conceptu^ilized test structure. 

, Language Development was conceptualized as a much broader construct 

-4 

than those measured in the other four subtests. Characteristically, it 
is the subtest with the weakest discriminant validity. Although it is 
distinct, its average factor loadings are only .33 with its own factor; 
five of the 12 Language Development items had cross-factor loadings of 
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the same magnitude as the wi thin-factor loadings. 

Factors six and eight are associated with pupil's ethnic group mem- 
bership. Factor six has high loadings from bilingual ism and the Spanish 
surnamed category. Factor eight can be called the Black factor, but the 
factor loading is not as strong. 

Additional analyses,' in which demographic variables were deleted or 
in which subtest scores and total score were omitted, did not alter the 
factor structure. When the. rotated matrix was collapsed to six factors, 

4 

the structure was the same; the five subtests remained distinct but there 
were more cross-factor secor;idary loadings -from Language Development items. 

The oblique pattern matrix is essentially the .same as that obtained 
from the orthogoral rotation. Each subtest still has its own factor 
with very few it^ms loading on other than their own factor. When nine 
factors were rotatedf four of the six Immediate Recall items loaded with 
the, last two factors as well as with the Immediate Recall factor. Two 
Language Development Uems appear with factor eight and have only minor 
'loadings on their own factor; this may be an artifact of item difficulty 
since these two items are much more difficult than other questions in 
the same subtest. 

The various factor analyses confirm that the constructs measured 
by th^ ELT are correlated, but provide additional evidence that they are 
not redundant. The following intercorrelations among the factors were 
obtained from the A'Aoc L oblique solution. 
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Factor Correlations 
A'A « L 







CO 




* ID 






00 






s- 


S- 








s- 


s- 


s- 


o 


o 


O 


o 


o 


o 


o 


o 


o 




4^ 


4^ 






4^ 


4J 


4^ 


4^ 


u 


O 


O 


o 


o 


O 


o 


O 


u 




fO 


♦ fO 






fO 




(0 




U- 


LL. 




LL. 


LL. 


Ll. 


LL. 


LL. 


LL. 



Factor 1 
Aud. Di scrim. 

Factor 2 
Imin. Recall 

Factor 3 
V-isual Di scrim J 

Factor 4 
Letter Recog, 

Factor 5 
/Spanish 

Factor 6 
Lang. Dev. 

Factor 7 

Factor 8 



.07 -.20 .27 .14 -.30 -.08 -.10 .05 

.11 -.12' .02 ..18 -.02 -.07 -.33 

-.27 -.07 .34 -.01 .05 -.06 

.15 -.36 .04 -.06 .03 

-.20 -.03' -.03 -.01 

-.05 .19 -.08 

.00 -.04 
.05 
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The five pre-reading skills measured by the ELT are expected to-be 
correlated but distinguishable as separalte constructs. The factor correl 
ations and the factor matrix together support this conclusion. From the 
correlations between factors one may infer that the constructs are not 
orthogonal; from the factor matrix It is apparent that the measures of 
the constructs are sufficiently discrete as to warrant separate factors. 
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ELT Correlations wi th O ther R eadin ess Measures 

■ : 

Findings from the multitrait-multimethod matrices were mixed. The 
attenuation created by the eaTiTiess of the ELT is obstrvable in each of ^ 
the matrices. (Appendix D) The subtests of the other tests are much 
more highly intercorrel ated than are the ELJ subtests. ySubtes-ts within 
the CTBS are sometimes correlated as high as .7.0. (Values of .8 or .9 
were also obtained but these were due to items from one subtest being 
combined in other subtest scores; e.g., Auditory Discrimination in the 

Clynier-Barrett is a comb' jtion of Beginning Sounds and Ending ^'Jiounds . ) 

I 

; ^ 

The hi^ghest intercorrel ation of ELT_ subtests in all four samples was 

.48. \ ; • "j 

Ordinarily, in evaluat ng.inultitrait-multi method niatrices, one looks 
first for evidence of convergent validity. Different measures of the same 
construct should be correlated. In order to satisfy the criteria for 
discrijninant validity, however, the correlation between different meas- 
ures of the same construct should be greater than the correlation between 
different constructs using the same or different measures. Because of the 
marked difference in the variance of the ELT compared to the other tests, 

/ 

and hence the difference in the levels of^the correlations, it v.as impos- 
sible to observe this stair-step\evidence oV discriminant validity^ 

The Auditory Discrimination subtest had the greatest variance and 
consistently had discriminant validity from other subtests as well as 
convergent validity with other measures of auditory discrimination. For 
example, in the Clymer-Barrett test Beginning Sounds correlates .55 with 
ELT Auditory Discrimination. This coefficient is greater than the correl- 
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ation of Beginning Sounds with other ELT subtests oi- the correlation of 
Auditory Discrimination with other Clymer-Barrett subtests. The; Letter 
Recognition and Visual Discrimination subtests had convergent validity, 
but in some tests their correlations with different skills were as high 
as the same-construct correlations. The Language Development subtests 
had convergent validity with other language subtests but only weak dis- 
criminant validity. 

CONCLUSIONS 

The results are encouraging for using the ELT in the California 
Assessment -Program or in other large-scale assessments. The evidence 
for convergent validity of the subtests (item intercorrelatidns and 
subtests correlations with other, measures of the same construct'^ meets 
the basic requirement for construct validity. The additional evidence 
of discriminant validity suggests that the subtests, even in a very short 
and easy test, contribute uniquely to the total variance; the test is 
likely to be a useful predictor. 

Because the ELT subtests are factorially discrete, the rules devised 
for constructing ELT items should be of interest to the authors of other 
pre-reading instruments. For example, the decision to eliminate auditor- 
ially and visually similar distractors from the Letter Recognition subtest 
may have helped to differentiate that subtest from the other two. Further 
examples of t.he procedurejs followed to try to develop "factor pure" sub- 
tests were the efforts made to distinguish auditory discrimination and >^ 

i ^ 

ilmiediate recalTfrom language development. Auditory Discrimination and 
Immediate Recall items wejre Screened to eliininate unfamiliar objects; 



I 

for example, birds, trees, and balloons were used but hats and roller 
skates. were not. In addition, in the auditory test teachers named each 
stimulus and all the response choices so that vocabulary would rot inter- 
fere with the skill being ir.<;asured. For all subtests the number of 
response choices was never more than four so that children wo^ld not 
forget the stimulus as they worked across a row. 

The ELT was not designed to make decisions about individual 
children; the subtests are too short and too easy to give accurate 
infx>f:mation aboujt every child's strengths and v/eaknesses. Even at the 
school or district level where the results are very stable, the inter- 
correlation of the subtests overshadows their unique variance, and makes 
it unlikely that differential information will be obtained from the sub- 
tests for use ^1n program diagnosis. 



/ 

14 



to 



O 
O 

o 



o 

t/) C CO 
Ul o 

O 

I to 

> OJ i— 
UJ J- ^ 



O 

q: 

H- E 



to 



13 



o 

CO 

11 



NO 



4-> 

C M 
(I) 



> ^ 

S o 
n 

OJ 

CT 

C CO 



CO 



to 

'rz in 
o ^ 



■o 

<: 



CT 
O 

o 



^ m CO 

o o o o o o 



tn CM o 

O 



CMCM*-*C^i-<CMC^<Mi-«CM 



•-4 ffv r*" I 
n —4 



o o 



OOOOOO^O OOOOO iOOOO oooooooo.oooo 



cn o <r <T o^.r* GOo^^o'OOvooocMCM 

O^OOOC>^i-<CSlCSlCMf-<.CMCSl«-«<^r-'<^ 



r- o o cr» r>- io m r>« i/^ cm cm |cn cncOcncCcor^vOOvJO 

C"— OOOOCMCMCMCMCM Cs* CM CM .-i «-«'CM CM CM CM r-» 



<r 

o o o 



in 

o o 



O 00 

CM <M CSk 



t-« CM CM CN '-• 



CM r» 

C4 CM. ^ 



2§ 



>J CM CO < 00 
CM n CM CM CM 



CM f-< r>. 

m CM 







o 


o 


n 


•-4 




CM 


ov o!*n 




cn 


00 




o 


00 




•-4 


nO CO 1-4 


cn 


•-4 r>. 


o 


o o 


o 




CM 


CM 




CM 


I— CM I CM 






t— < 


t*4 »— < 


CM 


1— • 


t-4 


CM 


1-4 CM 


CM 


CM CM 


> ON 


o cc 


NO 


NO 




o 




CM 


cn ojoo 




CM 


«n 


00 NO 


CM 


r> 


CM 


CM 


<\r 




cn o 


) o 


o o 


•-4 


o 


CM 


CM 


CM 


CM 


CM CM icM 


CM 


CM 


CM 


«-« f-4 


CM 


CM 


CM 


CM 


•-4 CM CM 


CM 


CM CM 



.-4 n r>. <f >J 



NO n CM ov cn 
o ^ o 



o>i-400r^i-4CMm^ooooocc 

O •-4 O O r-< |CM CM CM n CM CM 



o in m in r>. 
n n n CO n CM 



1-* o in o in 

cn cn n n n CM 



1-4 NO CO 1-4 



O'-'OO •-•0"CMCM<MCMCMCM 



fO cn ^ cn CM 



0«— •cmovcmc*c%,'>.o o CO « r>» "-^ on r>» o 

•-4,-4i-40i-<0|<M?McncnCM<MCMCMCMf-4 w-4 ^ 



0> \0 <D 
CM CM O 



<r o 

CM O 



m r>. CO in ON <f 1cm 

CM CM 1-4 f-H f-4 f-4 ^ 



n NO in r>. n 

CM CM f-4 f-l f-4 f-4 



o nO n —4 r>» vC 

O CM C-l CM — 4 I-* 



m O — 4 r>» 

CM CM CM CM •— • •— • 



ON CM CM CTN n — • Jin on r>. oo <j- 

0«-*'-<0«-;4»-«{CMCMCMCMCMCM 



On ON fN. CO 0% NO 

o o o o o o 



•-4 r*. o cn CM O 

CM f-4 CM CM CM CM 



ON n CM 00 f-4 



OO (-4 00 NO iTk 



0«-4'-*0— 4f-4CMCMCMCMCMCM 



•-4^-*Nor^OOU3'cn«3'-^cMcn 

~~ * KM CM CM CM CM CM 



•-4 f-4 O O ^ ^ 

O f>- CM o *n CM 



On vC cm CO r*> CM 
o o •-^ 



CO <T ON r>. 

CM CM f-4 f-4 . 



CM ON CO <f O-vO 

en CM cM-n n cm 



CM — 4 m n 
CO CM n n cn CM 



CM o% I 

CM • I 



in cn 
CM c** 



CO o r>- CO 



CO cn 

CM CM 



O ' 
CM r-* 



o 
n CM 



r>» ON iTV' COTT- 



ON vO 
CM CM 



o o 00 



in r>. 

V? CM 



CM >J 
^ CM 



cn <r. 



f-4 m 
cn cn 



NO \0 

n CM I 



ccfm 

: CM in 



f-4 CM O 

cn cn o 



CM CM 



n CM 

CM CM 



CM CM 



o 

CM O 



. o in 
I n CM 



ON ^ 
CM CM 



vo m 
CM n 



o^ 



o ^ 
n CM 



NO n 

CM CM 



r^.o 

CMjO 



<r in 



(-4 ON 

in. n 



O in 



^ o 
m o 



ON rn 

-3" -3- 



f-4 O 

^ o. 



I o 
o 



00 cOnO m<j-NOCN>cOvr r<- on in r>. «»n r— « 

f-4 OOOOCO--'f-4--««-4.-*'-^CMCM 



00 NO ^o <^ in vO 

o o o o o o 



ON CM in ON <r 

CM f-4 CM CM f-4 CM 



NONO'^^mor^cooNCNnooc*^ 

000000«^«-^«~'CM»-4CJ 



r^f>»>5-n\Ofcn'fMONOnON 

OOOOOOKMf-«CMCMi-< 



NO O "-^ 
O O O 1-4 o 



CM CO 

rn CM 



CM 



O Cn CM CM f>. 

CO CM n n CM 



On ON >j in 

o o o o 



f-4 sojo 

•-4 O 



On ctn in r>. 

CM CM m CM ( 



in —4 



o 

i o 



cn m 
cn n 



f-4 m 



vO o 
cn o 



I o 
> o 



ON O 

rn o 



m ON in 
o o o o 



00 NoJf^ 

o o cn 



m On 00 
O O — ' o 



^ o 



00 f-4 f-4 CO 

O o 



tn .-4 <j- o ( 
O (-^ (-^ o < 



CO m CM in 
o •-^ o 



On <r r> o 

O "-^ "-^ •-• ' 



CO <— • On CM 

m m n n 



o CN o 
n m <r o 



• NO >^ o 

m o 



00 o 
m o 



I o 
o 



CM O CM -4 
m CO CM CM 



f-4 O 
CM O 



< 

X 
•r- 
13 

C 



On O 00 in 

^ CO 1-4 cn 



NO O 

CO CM ^ O 



ON O 

1-4 *-4 O 



vT O 
^ O 



o 
o 



15 



*-<cMfo»j«/%Of>-«>ONO '^*<' * "o ^— 1/1 o I*. a> c r» ?m«or*7 oo— ♦cjcn*.?triv5 
t-« —4 •-4 ^ f-« r-4 (%i CM f # 5 , »M C'l f ^ f-j CM ri CO •o m fO 



\ i 



c» 



u 
a 



of 
o 



rr 
O 
>- 

o 
< 

Up 



•^•^iTk^^r iT* — ' o tr ■O' 

OOOOOOOOO'^C'i 



ooooooooooo 
t 1 I 















»-» 


h- 






^ O 


CM 






in 


0* cc 


o 


rv 


in 










< 




•—4 


^ 




r- 










o o 


O 


O 


o 


c 
1 


O O 


o o 


O 


1 













rg iT 
O rg 
^ ^ 



O O O 
I I 



CM w 



in «0 -* O rg sj- 
cs^ \0 O fvf lA 
^ c* o r*" sf 



rg u> Cg O ^ 

>n O O C*, r* 

IT fo CN r>- r 

nJ- O O nJ- 



f- f\4 (Tk O O nJ" r , 

^ o f •> ^ olo O O O O *^ 



—* — < cr^ <^ 

in ^ CP xT 

O rg ^ ^ r»» 

C fn r«- — 

-* ^ O O 



oonoocoooooo c 
I I I I II 



rg a> <\i O c o rg CO oc- »o 
oO'h-fs^inn (-'■<: m 

^ fs. (7 ^aO rr. j/NxTCL fv, 

O ^ O O O O'O O C C cs. 



C^ O CO -vt O eg 

sO ' CO 

C ^ fi «o c< cr 

(JL ^ m r-t 

^ C C ^ O O 



O O O O C 
I I 



nj ^ in h- r» 

00 ^ o ^ a 

O r»- n ^s. 

(.T in I «-« CO i-i 

O O fv. O O — 



C Ominoo^r-inO »oinoo 
r^in^rg^inr*<*^^"|*'*' 
r^Tj> O r a* sO O u» 

o o — »-« oooo*^<*> 



■ O 





rg (*\ 


rg r- 






<r 


^ O 1^ 


CC 


in 


rg 






>?■ 


m 


rg m 




rg 


o 


O — 



ooooooooooco 
II 111 



Oc^^^ccOO^>^Otf^^^ 
C^0^00'»org0^i<^0»t 

Oinrnrv— 4fO^-»r in >i. 
OOOOOr-^oOOrg^ 



fo r« ^ 



O C O O O O 
I I 



krcc^<x;ojrg^ino<.«*»rvi 
^ u ri xT C^* O m ^ 



O O O O O O 
I I 



rg O — « I/* O 

IT O a 

o ^ c a ^ 

« rg ^ O' o 

o o o o o o 



<5 00000000000 

III t ' 



cru^-^wrgr^r-w tr«-<co 
o rj — < »r i.> Cr 'S — « O <\j 

^♦■grgrg^^^C<"»<^00 



OOOOOOOOOCO 
III 



c o 
t 



0 o o o c o o 

1 I 



1/ 

c 




rvj nT n O vT ir. 

O -^r in ' o -^t 

v/ r o cr o r- 

t~ nT f\j (T 

O ^ ^ O rg 



■*r f*Ti O <x.> «-* X 

^ o cc c 

»-< O O '^' 
^ O O O O 

o c o o o o 



j» ^ o a 

O O C/ r~ 
fN. cr in nj a, r*" 
rg o nO C* ^ 
— * — < o o o 



o o o o o o 



ccmin-^h- o'jr-n.« 
0*-«r»iX0»*»'-*O0 



0 o o o o o 

1 I I 



f^j O o o ^ 

-^r <» u'v u 

i;» ;x> fa r- (7 ^ 

ri in m in 

o O o o o 



o o o o o o 
I I 



O in rg 
,C nj <x> —< ^ 
c o in o: >o 
^ ^ ,r ^ O ^ 

I ^ O ^5 ^ 



o o o o o o 



f*» 00 a" in 
m nJ- n <r 

O C r. fv' C 
CO ^ r*- 

o o o o o o 



oooooooooooc 



f»- >t> CD rv» r>j 

vO in o cr 

fS. O ^ C" 

C < IT %r in 
^ o o o f*^ 



o o o o o o 



O O O ^ O c\j 

w* ^ ^ O ^ 

CO O ^ nj ^ 

o tn »— « ^ 

« 1-^ o o 



o o o o o o 



0 xT xj- o in ^ 

C >C ^ 

^ or -* O C ^ 

^ ^ O cc in rg 

^ — ^ o o ^ 



o o o o o o 



i/\ ^ in <n r J in 

xT in o cc V* 
^ tn ^ — in c 

^ a-l •-4 O 



i.'^ in *r ^ r* ^ 
O o f^' in ^ 
O <3r x? 

o «-< o 



OOOOCCOOQOOO 



jr C ^ >0 ^ <r O * > C f ^ 

rv r<> r, ^. sJiJ"*- in ^ 
n r rg r. .''^ rg n».kf» cm c ^ u 



u 




















<1 


o 


O O O 


o 


o o o 


o 






u. 


1 


1 1 1 
















xT 






















u'^ 


rg O 


<^ 




— < 










>J" 


si- nj CO 




o 










^ 


a 


O 


r>\ O »-« 








in 


r- 








O 


f*» nj 


o 








c 








c 


o o o 


o 








o 


























< 


o 


o o o 


o 




o 


o 


o o 




u. 




1 1 


1 






































O f ^ 






r« 


«r 










o 


ir> <^ 


in 


w 


■> 












•—4 


in C'j tr 






</ 




r* 






O 


o 


o in 


c» 




r- 






J 


r 






o ^ 


o 


<J> 


w 
































r> 


*:> o o 






i 












1 


1 1 

















r. CO <x^ If 



n --^ o o c 



f 

o 



^» x> cf— < ir O 
r?> ^ r~ ^ r -^4 
*» If -4 r« 
tr r>» i^' 

O O O O — 



o o o o o o 



— * or. c O cj 

h- sC — ' ^r ^ 

O <r fg ^ 

<> U' 

— O O O O O 
***•*• 

o o o o o o 



1 o 
4^ r* 1 



%r '-'j * c m c 

<, p*. rg a-H or ri u 
^ ^ r-i flj-vj O iT C 
O O — * C 5_J •J'jj-o u> ^ u< If 

• ••••• ••••• V 



^ O *r 



O O O O O b 



<; ir^ in 00 ^ 
>C »n f v.* 
sO' ir in «\j 

• * • * 4 

o o o o c o 



-H in 'T r-* ^ O 

■Xt eg 7* 

^ Ji ^ «r 

in m -* c o 

<\j rg — • O — • O 

O O O ^ o O 



O O O O O C 



cc O in ^ <^ 
-n r- r" ^ 

^ C r. 

r* ^ o o o 
o o o o o o 



CO <n m CO o 
^ o <» o 
V* ^ c 

f> n. ^ ^ ^ 

c o o c o 



■jooooooooo^to 







^ OCT 


cr 




m 




O 


to — 






m 


O 


<>i r» 


r> O "X' 






ra 




C nj >r 


T. sO r-i 


O 




r J 


o o 


o o 


o c cr 


o 




O 














o o o o o 


O O O 


o 


<^ 


O 



in "xj 

^ O O IT 

J* r< cr 
_ ^ r* 

t-H 'Vj <<t| (*\ 



o 1?.'^ ^ in m nj 
• r^jc -r nj r*\ 
r^fM o -"^ 

^ ^ n ^ O ^ O 



c o o ^ o o 



r- «v 

f-- IT C" 



f6 nj ^ r- 

f>. r« <N X 3 

o n o in r~ 

.<\j ^ o o — 



^ <M 

"> ^ v:. 

* xT 

^» <; 



xf r 

r- C 'I 

^ in c\ 



X <M r-j 




O 


>x <^ o 








ii> ^« n 






f-« CJ 








O i'» </ 




-0 






•J 




tr nj 




.n 










nj eg ^^J 




*^ 










o O O 


•J 


o 


o o o 


o 


o 


o 



0 0 1.^00 o o 

I I I I 



O O^O o 



o o u o o o 



o «^ 



3* r 



c 

u 

X 



O h- r- XT* 

0^ 30 <^ X 3* 

^ in 

h- i*» O'' ^ xT D 
Q ^ -I -I r» r 

o o o o o o c 
lilt 



' <r oC' «-r 
-:> c o c 



i*\ n\ w~4 f-» J f- r '» u 
^1 c > ^/ r C r« — < 



c^v sn " 



! rs. rf 



I/O a: o o t>o (/> uj 

.J CP d O t/%\ 

-3 z: i. H- o oo ^; 

zi<r*-»uJ«-'-Jc:>— J--J 

o :^ H- <! 

t/) — J <X »i. »-« /T* c~i tn cj 
UJ • — » Ci, X — > — * -1^ c 
CO 03 CO vO ^2 wO wo 1/7 1/0 h- 



o O O O O 



Qi cn 
4-» o 

Qi OJ 

-jp: 



^ J h- ns -t 

>^ ♦CVJ ^ u 

>r xD vC 



^f <t rg 



n. O f J 



H-jr- r J ro ^ t/> lO 



» «^ Lki iAj i 



r>- CO CT* O r— oojro ^ «jO CO 



3 o o o o o 



r» e o a H 
^# ^ /\» /T) O n. 

' J O O C O ^ 3 









m 






-J c 


r 






u 










in 


cr> 4 






ri 










r-i 


0 


o 0 


0 


0 


0 



C7» > 



0> O f— 

CSJ CO 



CM fO 
CVJ CM CM 



i LU llJ UJ u) tU Ui LU UiluJ UJ uj 

• H- H- H- l- H- H- H- H- H- 



c\jrjc\JC\jnjroroco'^rororo 

UJ UJ UJ.it.i LlJ Uj uJiUf i^l uJ CJ UU UJ UJ UJ 
H- H-iH- H- H- H- J— H- H- H- 



2: z: 5: s: 



16 



CO 



c 

<u 
a 

Q. 



O -i 

Hi < 

CO 

on 



I. 



OL* u** ro ^ Ku co o rr> O ir^**::- to u^l^ 

C Cvj lT* CC CNIfO^ <x c > r-* ».l|CO CM 

cj c o o c_ vr* CM * J- *«^r CM to ' 
00 00 c 



I 



Li '' '* j] * 'd\ ' ' 



ro to »r ifi o CO #— 

csj r** u > »-< tr» 

c> i-i oj c ' u"* tx: <vi 

^ I I, ' CViUNi O 
C r— 



cc ir> CO cc 0» ^ r-» <i^3ro rojrJr-^ <o*^'o> 
csi C <T» cj ti:. ^ r*- 3-0 u"* O^icr 0|0> ^ <s» <nj 
csj CM CC o CM CO r>. c*^ r' ir^>0 --r Cs-jC*:? 

0000 Or-^oo o:rojO 

r * r * * 1' * * I'Lii 



CMlCOjO O^COiO 



I 



CO CO c? CO CM 
o cr» U~) ■:T 
O 0> 3- ' CM 

CO O O L - C 

o o 00 ^ 



o 



o 



a. 
o 



(X 

o 



ro 



< 



en 
o 



< 



o 



< 



tr» CT^ ^IcO tOrl-*— r-^tO'rr^r^'— 'C!;^ 
to w r>*iro CO — ro cr> o>.u-v o ^ CO 

C-i .."^ Csi f--t}*— ) CX» Cn C> ti.> OJfM CO 00 CM 
CM r-<-r^.!o CMlO O t^ O 0> O'O r-M ,-4 O O c:. 



tr> ^ o cr» 

ro r— ^ 'CJ' 

tC •— tr> 

CO VO O CM CM tr> 

00000^ 



0 o «r cr» -nr 

r-^ f:r« u'* 

01 »-« C> ^ C~ 

O O^-- ^ ^ 



^ <onr> «-t 

to CO ^ »^ ■ '-i ' . 
CM •-t'f~* <••' 

«—»»—♦ ^ Oj 

r-< .-4 O r-H, 0^1 



r-<t»r C'^ic^.iiijDt^ cr» .-4 00 CM 

C^t^ ' f - O '^t -T^ ~ i-O VC » 

r>*tc; - I'^T, <-r '^r <-4 «:r ro 
oj^O O r>*lu^lO 00000 



I 



00 C> tD CM 

-tr CO -CTv ,— 
CM CO O «:r f— 
C o »— 

O rl O O OCM 

I 1 I 



-0 t\i ^\ <^ 

^) cn klj c\i o 
:\t ^ CM CO 

' - tO »^ O CO 
r-l CM O r-ilrOjtp 

r • r '1 



nj- 0^ <-* O to CO 

, - OO ^ CO 

r-i CM «:r 

-^J CX) iO CJ Ca^ O 

000000 



CO <r» CM 0> CMI 0!^ 
iTi C- O CCiC> 

ro c r-- CM CO 

tO CM r-H CO 
O r-H O O O O[C0 



I I 



I 



I 



4^ ^ coG to to »-H CO CM —4 CM CM CO »-H 
r-T in Oi^lpo r^r>*^DO^«c:r7-ror^p^co'^ 
r'v uo c^'Oi^ro cm ^O coiii*> CM ^ co 
O (T' <7<iMtr-« O O r-4t"^ O CM ^ CO 



^ O ^ ^ rvj ^ 

VO tjj r— 
CO »— ^ CM O 

u;> CO ^ ^ »— 
o O O *— O o 



cr» cr> to ^ 

»-H CO r-H n*- vr 

cX' cr* J 
>-H Cs5 cc to 
o o o o o 



o o CM CO o 

rv. tO ^ CO CO 

CO CO ^ 

0 CO O CM O C. 

000000 

1' r I 



000 



c;? o o o o oUo to m to tn ic> 
I 



I I 



••r vc O a"^ CO CM CO o ^ CO ^ o CO »r> 

f-l ^ 1^ cO r-H L.^ ^ r-H mO, V O *J CO ^ CM 

tr>r^'' r'-,CMriJ>ci<^i'^«^,w r^C" r-<ti">co 
<js m ro '>o r>»^ p o ko c^ 

00000000 03, o iovj O'O 0000 



u>— - _«^i-or^<T>C0C50O^O^c^Jr^CMt00;v 

^ «^ » I /VI /V 4 ^Tk I 4 r. t i <r?- c_ 



O to »^ O «=r C " 
CM vo c^ 
000000 



I I 



I J 



CO Cvj O ro CM' ^[O . ^ -r 'NJ J' O iO o 

J O^.CM.r-^ T • ^ f ->,«0 U 

^ -I to o U-* <-« r J o in,cM'a^ rr 
0000 C*r^ O O o O .^4 CO to ^jCNJjCsj t£i 



I I 



CO to CM 

^"^ 

*— 00 t*^ 
^ CM 
000 



.— to o 

CM 
CO V 
ti- tc to 



O vOjCO 
CO r^lfo 

to O 

O CM,C 



CO to «r> 
to 

000 

1 



O CO CO CO 

CO ^ ro CM to CM 
CM o 0> cr> tc 

SCO CM O #— CSJ 
00000 



, — to CO to 

00 to t^ O #— CM 

to CM to c^i 
CO o CO to c::) 
.— ^^000 



CO tn cr» to 
o O *— fO CJ> 
O ^ r— O CJ 
CO Cr> 00 CM CM _ 

^^0^00 



#— CO ^ CO I* 

O CTi CO CO «^ 

UO •cT ^^J" CO O to 

CO CsJ *— ^ o 
0000c.— 



I 



I 



I 



I 



to CM 
o O c:^ 

a to o c^ t*") 
CM o> CT ^ 
.— 0000 



O •— OMO 

c CO <yt CO 

O r— Or^ U> 
^ CM O O 

0000 

• • • • 

I I I 



VOC^Nil^CTtCM COr— CO'tC 0\ 
CVJ ^ ID CO O. ^ »— f— O 

cr»o^ 4DCOOO torn cr»tir> cm 

CmOCM* — CMCO »— jco 

ooooco o.— oico 



cmOO»— ^CO r^tO^^cncM 
^cocmcm^:?-'— tOCMr^iM*^^ 
, — ^r^cor^totoo^r^^^^ 
^r^rrf^^*^ CMr^to*— CMf— 
CMOOr— cmO o^»— OOf— 



r^co^r^OO^co^CMCOr^c: OCO 
o CO ^ r— CO o> « — CM u> OD CO O 



CO -r^ lO crv ti; 

CM ^ C CO lO 40 
f— r— O O O O 



\c f\i "oo '^r CM « 

.->«^^Or— OC r^#— < 

CO ^ v> ^ <r CO CO CO " 



O CM CO CO CvJ 

c»> CM "cr CM CO 

*— Vt tD to "^^ 
CM CM »— CM O 

000000 
I* * I I I 



, — O ^ O C7> 
uo ^ r-^ ^ CO CO 
uo ^ #— O cr> O 
^^0000 



VJ tM KT V, » ^ Li < 1 ^ C- J I ^ V» ' - V 

O to CM *— «— CO'CD CO CM to UO <0 
»— O O O O 0l|0 to to to to tC 

I 



'^ uo Cs. to 
. TT or C^-i cc 
- ( CO CTi c: c J CO 

CO tO CM CO CM to 
r-H O O *-» O 



to OD 
CO f o 

rr 

O o 



6S 



O CO 

c-1 o 
ro ij^ 
.-« c 
o o 

I I 



CM C» O CM CO CO <^ O r-H 

lil f ^ CTi C J t^ r-4 r-4 

-r'c>j f^J'c 1 CO O T a C> O 

O k rsj'i^) O r-H r-4 O CO 

00^0 o.cho 00000 



I 



00 




to 


to 








cr» 


KO to 


CM cr» 


CO 


oc 


a> 0 


^ CM 






0 

* 1 1 


000 
1 1 1 


0 
1 



^^7- r** ^ ^ ^ 

OO^OOJCMCMO^tOtOOvO^C 

cocvJ^OOt*'^,»^cor^to — ^ 



to 




0 


0 


to 




CM 


CO 


CC 






to 




CO 


C<J 









f1 



C^CO sOCMCOCM tOlOCOtO*— 
r-C>oOr— <MCO OCMCO#— COtO 
r^COr^^-^-^J-r— ^^CMtOCMCM 
OtOi-OOuOtO OtOCMCOCO»— 
OOOOCM 000000 

1" * * * I* I r I I 



00Or^C3%c0C0O»— coco 
CM*— ococo<7»CMr^cMcoCr»to 

f^OCOOOtOC>*— #— to,— OCO 

Oc\ir^O#— O voO';rO^O 

r— Or— CMCMO O,— OOOO 

I* I* I I I I I I I 



,-.r^toa>c>r«' to^tocMO 

r-C^tokOcoC or^to — 10 

r0C:000COC0< CM^TOOOCV 

CMOtOCMrr»— OOCOCOr^f-" 

^^^CMOC 00000 



^ CM a? CTV CO 

CO to CM CO o-> 
00 to ^ to 

^ o CM ^ CO 
000000 



to ^ 

IjU 

10 CO 



CC 

3: 

«>0 

^^ ^ I 

1 

<■*.«. I 
^ Ci. 
CO to 



5c CO 



I UJ • 

; Oc: o 

UJ o 
. -J <£ 

uO to 

;o o 

UO I/) 



00 to CM ^ 
*^ r-« to O CO 
ro CO ^ O to 
O 00 CM CM O 
O O O I o #— 



I/) UJ 
H-» O H- 

O CO 
O UJ 

OO^H- r-HCMCO^l^tO 

>. ^ „ ^ ^ . 

. . . • cs. M VL. ^- 21 5l 

ca CO » aj kij Lkj iaJ tjj tiJ 

;3 ^ o r- H- H- 



ERIC 



CM i— 

O*) to CO 
<m T to 
fJJ rr 



I I 



4J O 

(U CD 

00 cr» o • CM 



UJ LxJ tu t^ 
— h- ^- h- H- 



■ to 



CO i— 

o ^ 

CM 

cr» r— 

to to 



ro 0> ro ^ CC 
O ^ CO 
CO ro to ^ to 

«T tO CO CO f— CM 
i— O O CM O 

t I 



uo^c>cr»cMr^tr tocMcoco;^ 
to^ocMCOa r^toiotoo 
CMCM<^o^»jO«rrC cr>roco»— ^ 

COCM^OCM-c?*— *— COO^^ 

oocbf— f— oc 00000 



to rt 



T3 

•a: 



CO ^ »o 



u 
o 

to * 



I ui tu I 



17 



J 00 
to f— 
tiO o 

o o 



^ CO CM 

o nr o 

O CO ^ 
to CO ^ 

000 



I I I I 



. o 

■ CM CM 



cvJ CO 

CM CM CM 



O O 00 

r— 

00 i— 

00.— 

r I 



o oc 
CM C 
o ^ to c 

r- i— CM 

o o .— c 
1 I 



10 tO^O CM 10 
Tj- tA to CO 
r— to cn ^ ^ 

O CM CM fX- to 

i— o o 



lO to 

CM CM CM 



CO CTk O r- 
CM CM CO C^ 



UJ UJ UJ UJ I 




^ to 


to 


CO CO 


CO 


2=: z 




UJ UJ 


UJ 


»- H- 









s" s a s 5 s s s s s 

3 a s a s « s s s a 

a a X a s a s 2 s 2 

9 3 8 s s s =i s 3 s 

i 3 s a s s a =. ~ ~ 

£ 8 S 3 8 8 2 8 3 S 

I q 3 3 K 3 = S E 3 



5. 

3 

8 



S S 3 S 3 

S S S R 
8 T 

3 




1 ^ 



1 , 



I 

1 



i s « ^ 3 £ s c 

e • ^ 2 

V 2: 2 ;x 5 

^ - ^ q 

« 8 S 8 3 S 



o 

■o 
c 

Oi 



a a 5 
e c 5 



s 3 ; 3 s s a s 
s 5 s s 5 s s 



1^ 
SI, 



111 
I 



q ~ ~ 

~ T ~ 

S o = 



s s ~ 

3. 



i 3 2 



iff! 



iliii 

21 i 2 3 5 S 



2 
s 
e 
a" 



S 2 2 X S a 2 S 2 2 S 

S 2 5 S 2 2 = S S S 

5 s s s 5 a s a « = 2 

3 s z 2 = 2 - ^: 

3 S 8 ~ S 5 3 



3 S 5 5 a 

2 =. r - 
2 5 3 



~. = ^ 

S S 3 S 

5 5 2 0? S 3 S 5 3 S 
S K S S 



1 

Hi 
Hi 

\ - 

a 



I a s 5 3 

I =i s = =. 

I ~. = s s s a 

I S S S 5 3 

g S S S S 

3 =. 



|js!«.. = ;!lsn. 



.Hi! 



